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ABSTRACT 


A method  is  presented  which  yields  the  autocovariance  function  of  a 
stationary  discrete-time  stochastic  process  in  closed  form.  Special  reference 
is  made  to  the  Box  Jenkins  forecasting  methodology  in  which  the  underlying 
process  is  generated  by  passing  white  noise  through  a linear  filter.  The 
impulse  response  of  the  filter  and  its  Z-transform,  the  transfer  function,  are 
obtained  from  the  equation  which  defines  the  filter.  The  bilateral  Z-transform 
of  the  autocovariance  function  is  then  derived  from  the  transfer  function,  and 
is  inverted  following  a partial  fraction  expansion.  Several  examples  of  this 
procedure  are  worked  out  in  detail,  and  a summary  of  solutions  for  a number 
of  cases  is  given. 
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1.  INTRODUCTION 


An  important  element  in  the  development  of  forecasting  models  is  the 
autocovariance  function  of  the  process  to  be  modeled.  One  obtains  information 
about  the  nature  of  this  function  by  computing  the  sample  autocorrelation 
function  from  a sequence  of  observed  values  of  the  process,  and  one  then  uses 
this  information  to  establish  the  structure  of  an  appropriate  model.  The 
method  of  Box  and  Jenkins  assumes  that  the  process  is  generated  as  the  output 
of  a linear  filter  whose  input  is  i^ite  noise.  Thus  the  following  question 

arises.  Given  the  autoregressive-moving  average  (ARMA)  equation  that  describes 
a particular  filter,  what  is  the  autocovariance  function  of  the  output  of 

that  filter  and  how  are  the  properties  of  that  function  influenced  through  > 

the  choice  of  filter  parameters.  The  autocovariance  function  can  be  computed 
recursively  in  accordance  with  the  method  given  in  Box  and  Jenkins  [1] , but 
that  method  does  not,  a priori,  shed  much  light  on  the  nature  of  the  auto- 
covariance function. 

In  this  paper  we  develop  a method  for  obtaining  a closed  form  expression  « 

for  the  autocovariance  function  of  a discrete-time  stationary  stochastic  process. 

The  method  is  based  on  concepts  from  systems  engineering  and  makes  use  of  the 
Z-transform.  It  permits  one  to  express  the  autocovariance  function  in  terms 
of  the  parameters  of  the  ARMA  equation,  without  the  need  for  solving  systems 
of  equations  as  would  be  required  by  the  classical  method.  As  a consequence 
we  give  expressions  for  ARMA  (p,  q)  with  p > 1 and  q > 1,  which  are  not  to  be 
found  in  Box  and  Jenkins  [1].  Described  briefly  the  method  involves  first  ex- 
pressing the  Z-transform  of  the  autocovariance  function,  then  performing  a 
partial  fraction  expansion,  and  then  inverting  the  expansion. 

The  paper  is  organized  as  follows.  In  Section  2 we  discuss  the  filter 
impulse  response  and  the  filter  transfer  function  and  their  relationship  to 
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the  ARMA  equation.  The  autocovariance  function  is  defined  in  Section  3 and  is 
derived  from  the  impulse  response.  It  is  also  indicated  how  the  autocovariance 
function  may  be  obtained  from  the  ARMA  equations  by  the  classical  method. 
Section  4 develops,  on  the  conceptual  level,  the  method  for  the  inversion  of 
the  transform  of  the  autocovariance  function.  The  practical  implementation  of 
the  method  of  partial  fraction  expansion  for  linear  factors,  repeated  linear 
factors,  and  quadratic  factors  is  shown  in  Section  5.  Finally,  a summary  of 
solved  cases  is  given  in  Section  6. 

2.  IMPULSE  RESPONSE  AND  TRANSFER  FUNCTION 


We  consider  a discrete-time  stationary  stochastic  process  which  is 
generated  as  the  output  of  a stable  linear  filter  whose  input  is  the  stationary 
process  a^.  In  the  terminology  and  notation  of  Box  and  Jenkins  [1],  x^  is  an 
ARMA  (p,  q)  process,  if  we  have  the  input-output  relation 


X - d),x  1 
n ^1  n-1 


> X 

P n-P 


a - 9, a , 
n 1 n-1 


- 6 a 
q n-q 


(1) 


The  process  x^  can  also  be  represented  in  terms  of  the  impulse  response  of 


the  filter,  namely 
x 


’^O^n  + *lVl  h^n-2  + 


(2) 


or 

x » i((  * a (3) 

n n n 

where  the  symbol  * denotes  convolution.  If  the  coefficients  of  a and  x are  1, 
as  in  (1),  then  we  always  have  * 1.  Also,  the  Impulse  response  is  0 for 
n < 0. 

Now  we  define  the  bilateral  Z-transform  of  x as 


x(z)  =■  y X z " (^) 

n“-“> 

and  we  let  a(z)  and  ^(z)  be  defined  analogously.  We  remark  that  for  sequences 
which  are  zero  for  negative  values  of  n,  such  as  is  the  case  with  the 
bilateral  Z-transform  is  the  same  as  the  ordinary  (unilateral)  Z-transform. 
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Equation  (3),  when  transformed  In  accordance  with  (4),  and  with  the  convolution 
rule,  becomes 

x(z)  = \p(z)a(z)  (5) 

The  shifting  rule  for  Z-transforms  states  that  the  transform  of  x , is 

n-k 

z x(z).  Transforming  equation  (1)  according  to  this  rule  and  arranging 
terms  yields 


x(z) 


1 - 9^z 


-1 


- 0 z 


-q 


1 - <i>j^Z 


-1 


- * z 
p 


-p 


a(z) 


(6) 


Comparison  of  (6)  with  (5)  shows  that 


ip(z) 


1 - Q^z 


-1 


1 ^ -1 
1 _ - ... 


- 9 z 

3. 


-q 


,-p 


(7) 


The  function  i)(,z)  is  known  as  the  transfer  function  of  the  filter.  It  is 
customary  to  express  iJJ(z)  as  a rational  function  of  z,  that  is,  as  the  ratio 
of  two  polynomials.  This  becomes  necessai^r  if  we  wish  to  carry  out  a partial 
fraction  expansion.  We  multiply  both  the  numerator  and  the  denominator  of  (7) 
by  z™,  where  m * max(p,  q) . The  result  is 


4i(z) 


z”  - 9^z”-^ 


w • • I 


- 9 z 


m-q 


m m— 1 

z - (^^Z 


- * z 
p 


m-p 


N(z) 

D(z) 


(8) 


where  both  N(z)  and  D(z)  are  polynomials  of  degree  m in  z.  D(z)  is  the 
characteristic  polynomial  of  the  difference  equation  (1).  The  zeros  of  D(z) 
are  the  poles  of  the  transfer  function.  The  poles  of  ^(z)  play  an  important 
role  since  their  location  in  the  complex  plane  determines  the  nature  of  the 
impulse  response.  A simple  pole  at  z * a gives  rise  to  a geometric  sequence 
in  n,  according  to  the  transform  pair 
Az 


<-♦  Aa  u 
z - a n 


(9) 
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where  the  symbol  < — denotes  "transforms  into",  and  where  is  the  unit-step 


sequence  defined  as 


1 for  n > 0 


0 otherwise  • 


A pole  of  multiplicity  r at  z * a gives  rise  to  a geometric  sequence  multiplied 
by  a polynomial,  according  to  the  transform  pair 


A( — - — ) < — > A(n+r-l)  (n+r-2)  •••  (n+l)a^u 

z - a n 


A pole,  simple  or  repeated,  at  z = 0 gives  rise  to  an  impulse  according  to  the 
transform  pair 

— <— > A6  (12) 

r n-r 

z 

where  the  unit-impulse  sequence  (or  delta  sequence)  is  defined  as 

1 for  n = r 

6 _ - ■{  (13) 

” 0 otherwise 

A pair  of  complex  conjugate  poles  with  absolute  value  a and  argument  + S has 
the  associated  quadratic  factor 

D (z)  * (z  - ae^®)(z  - ae  ^®)  =«  z^  - 2az  cos  3 + i = (14) 

q 

and  gives  rise  to  a sinusoidal  sequence  with  geometric  amplitude  according 

to  the  transform  pair 
2 

Afz  sin  Y + az  sin(3-Y)  ] 

^ ' -Tr--*'  < — > Aa  sin(n3  + y)u  (15) 

z - 2az  cos  3 + a 

Only  stable  filters  are  admissible  for  our  consideration  since  stability 


of  the  filter  is  necessary  in  order  for  the  output  process  to  be  stationary, 
and  thus  necessary  for  the  existence  of  the  autocovariance  function.  Stability 


4 


implies  that  -*■  0 as  n or  equivalently,  that  all  poles  of  the  transfer 

function  lie  inside  the  unit  circle.  The  transfer  function  ip(z)  has  exactly 

m poles,  whj-ch  we  denote  ct^,  02*  •••»  cip.  for  m * p.  If  q > p then  m = q, 

and  q - p of  these  poles  are  at  z = 0.  We  thus  have  in  factored  form 

(z  - ot  )(z  - a_)  •••  (2  - a ) if  p ^ q 

D(z)  “ < ^ D-a 

(z  - Oj^Xz  - 02)  *•*  (z  - Op)  z^  ^ if  q > p (16) 

and  we  require  for  stability  that  |a^|  < 1 for  all  i.  Furthermore,  the  transform 
Xz)  exists  (converges)  for  values  of  2 outside  a circle  of  radius  R,  where 
R =•  max{la^|,  |a2l,  ....  lopl)  (17) 

is  the  radius  of  convergence  of  1^(2) . For  |z|  ^ R,  Xz)  is  not  defined. 

The  method  of  partial  fraction  expansion  allows  us  to  decompose  the 
transfer  function  (8)  into  a sum  of  recognizable  elements  of  the  form  of  the 
left  sides  of  (9),  (11),  (12),  (15),  which  have  simple  inverse  transforms. 

Details  of  the  method  will  be  found  in  [2],  Chapter  6.  A unique  decomposition 
is  possible  only  for  proper  rational  functions.  For  this  reason  we  first 
divide  ijl(z)  by  2.  The  expansion  then  has  the  general  form 


»(2)  , N(z)  , y 

z zD(z)  I D^(2) 


(18) 


where  the  0^(2)  are  the  factors  of  0(2),  which  may  be  simple  linear  factors, 
or  repeated  linear  factors,  or  quadratic  factors.  In  addition  one  of  the 
Dj^(2)  is  the  factor  2 if  N(2)  is  not  divisible  by  2.  In  (18)  each  term 
N^(2)/D^(2)  is  Itself  a proper  rational  function.  Therefore  the  degree  of  the 
polynomial  Nj^(z)  is  0 for  simple  linear  factors,  r - 1 for  repeated  linear 
factors  of  multiplicity  r,  and  1 for  quadratic  factors.  Detailed  examples 
of  the  partial  fraction  expansion  of  Xz)  are  given  in  Section  5. 
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3.  THE  AUTOCOVARIANCE  FUNCTION 

We  denote  by  u-j^  and  the  autOQOVarianae  funationa  of  the  processes 

a and  x . These  are  functions  of  the  lag  k and  defined  as 
n n 


\+k^ 

(19) 

^n+k^ 

(20) 

It  is  a fundamental  result  that  can  be  represented  as  the  output  of  a linear 
filter  with  impulse  response  whose  input  is  see  Papoulis  [3].  Thus  we 
have 


and  in  the  transform  domain 


(21) 


y(z)  = g(z)y(z)  (22) 

The  significant  part  of  the  result  is  that  g^^  is  obtained  from  as 

8k  ' \ * ^-k  ^23) 

and  that  the  transform  of  this  relation  is 

g(z)  » ii;(z)lil(^)  (24) 

where  ’j'(~)  is  the  transform  of  ip  We  note  that  g^  is  a yxonoccuadl  impulse 

response  because  it  is  nonzero  for  k < 0,  which  means  that  the  filter  output 

precedes  its  cause  (the  input).  Since  Mz)  exists  for  |z|  > R,  where  R < 1, 

it  follows  that  iil(— ) exists  for  |z|  < 1/R.  Hence  the  function  g(z)  exists  in 
z 

the  annulus  of  convergence  R < |z|  < 1/R.  We  have  from  (24)  thuC 

i(-^)  - i(z)  (25) 

which  implies  that  is  a symmetric  sequence.  This  fact  is  also  seen  from 
(23)  since 

8-k  ” -^-k  * \ ’ 81,  ^26) 
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If  the  input  process  is  white,  which  means  that  it  is  imaorvetated,  then 


where  a •»  Var[a  ],  and  (21)  and  (22)  become 
a n 


2 

j 

a 


2 - 

y(z)  » g(z) 


(27) 

(28) 
(29) 


The  problem  now  at  hand  is  to  determine  the  sequence  gj^.  This  can  be  done 
using  the  relation  (23)  which  is  explicitly  > 


= I '\>A 


i-0 


i^i+k 


(30) 


but  this  procedure  does  not  generally  yield  closed  form  expressions  for  g^^. 

Our  approach  therefore  is  to  invert  the  bilateral  transform  g(z) , which  Box 
and  Jenkins  call  a aovarianae  genevating  funation.  The  details  of  the  inver- 
sion will  be  developed  in  the  next  section.  Prior  to  that  we  briefly  discuss 
another  method  for  finding  in  order  to  allow  a comparison  with  our  method. 

This  method  for  computing  Yj^  is  alluded  to  in  [1] , where  an  example  is  given  for 
the  ARMA  (1,  1)  process.  If  one  multiplies  equation  (1)  by  a^  ^ , j =0,  1,  ...,  q, 

and  takes  expected  values,  the  result  is  the  system  of  q + 1 equations 
2 


“1  ■ *i“o  ' ■ h". 


- (JIjOOq  * - j *2,  3,  ....  q 

- 0 if  j > P 


(31) 


where  w,  ■ Covfx  , a . ] is  the  avossoovcan.ccnae  of  the  processes  x and  a . It 
j n’  n-j  n n 

is  apparent  that  this  system  of  equations  can  be  solved  recursively  for 

Wnf  0),.  u . Next  one  multiplies  equation  (1)  by  x , , k ■ 0,  1,  ...  and 

u i q n— K 

takes  expected  values.  This  gives  rise  first  to  the  system  of  p + 1 
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'0 

~ '^1^0 


rining  Yq.  Yj^. 

...,  Yp 

- 4»  Y = 

- 9,(0,  - 

• • • - 9 0) 

P P 0 

1 1 

q q 

- A Y , » 

- 0,(0-  - 

• • • - 0 (0 

p p-i 

1 0 

q q-i 

^ ■ ^iVi 


. • • • * A Y 

p p 


- 0 0).  - 
P 0 


0 0) 

q q-p 


(32) 


where  0^  * 0 if  j > q.  Thus,  if  q < p the  last  p - q equations  of  (32)  have 
a right  hand  side  equal  to  zero.  It  gives  rise  secondly,  if  q > p,  to  the 
following  q-p  equations 


Vj  ■ ‘*’l'^P+j-l 


♦pYj 


-9..a)--***-0od 

p+j  0 q q-p-j 


(33) 


j » 1.  2, 

and  thirdly  to  the  infinite  system  of  equations 


q-p 


"^r+j  “ '**l''’r+j-l 


- (fc  Y * 0; 

^P^r+j-p 


j * 1,  2,  ...  (34) 

where  r » max{p,  q}.  Equations  (33)  and  (34)  constitute  jointly  a nonhomo geneous 
difference  equation  which  defines  Yj^  for  k ^ 1.  Equation  (34)  constitutes  a 
homogeneous  difference  equation  which  defines  Yj^  for  k ^ 1 + max{0,  q-p).  In 
order  to  compute  Yj^  one  needs  to  solve  equations  (31)  through  (34).  This  pre- 
sents no  problem  in  the  case  where  numerical  values  are  given  for  the  para- 
meters and  0j , and  where  (34)  is  solved  recursively.  The  situation  is  dif- 
ferent, however,  if  one  needs  a closed  form  solution  expressed  in  terms  of 
the  parameters  and  9j . In  this  case  one  first  solves  (31)  recursively  and 
expresses  ...,  in  terms  of  the  and  0^ . These  expressions  are  sub- 

stituted in  (32)  and  (33).  Next  one  solves  (32).  Since  these  are  simultaneous 
equations,  the  solution  requires  essentially  the  inversion  of  a matrix  of  size 
p + 1 in  symbolic  form,  and  this  may  be  a difficult  part.  Equation  (33)  can 
again  be  solved  recursively,  but  is  needed  only  if  q > p.  The  homogeneous 
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equation  (34)  may  be  solved  by  the  classical  method,  yielding  the  expression 


where  the  a 


=•  A + •••  + A 

11  2 2 p p 

are  the  roots  of  the  equation 

= 0 

1 P 


(35) 


(36) 


The  coefficients  A^  in  (35)  are  then  determined  by  solving  p simultaneous 
equations  consisting  of  (35)  with  k = r-1,  r-2,  r-p,  where  r = max{p,  q} 

and  where  the  values  of  are  substituted  from  the  solution  of  (32)  and  (33). 
Here  again  the  solution  of  simultaneous  equations  in  symbolic  form  may  prove 
difficult.  It  should  be  apparent  that  this  procedure  for  finding  a closed  form 
expression  for  Yj^  can  be  a messy  one.  On  the  other  hand,  it  is  well  known  that 
transform  methods  serve  to  simplify  the  solution  of  difference  equations.  This 
is  especially  true  of  the  method  presented  in  the  following  section.  The  reason 
is  that  this  method  does  not  require  a separate  solution  of  the  systems  (31) 
and  (32) , which  are  not  part  of  the  difference  equation,  and  moreover  it  does 
not  involve  any  solution  of  simultaneous  equations  at  all. 

We  remark  as  an  aside  that  the  power  spectral  density  function  (or  power 
spectrum)  of  the  process  x^  is  readily  determined  from  the  transfer  function 
4i(z)  . The  power  spectrum  S(ci))  is  the  Fourier  transform  of  the  autocovariance 

function  y . The  Fourier  transform  is  obtained  from  the  bilateral  Z-transform 

n 

by  setting  z ••  e^*^,  i - / -1.  Thus  we  have  with  (29)  and  (24) 

S(aj)  ■ yie^)  » o^  iil(e^)ij/(e  ^“)  - |til(e^“)  (38) 

This  result  states  that  the  absolute  value  of  the  transfer  function  must  be 
determined  for  values  of  z on  the  unit  circle.  A graphical  method  for  quickly 
assessing  the  form  of  lij;(e^)  ] from  the  zeros  and  poles  of  the  transfer  func- 
tion is  given  in  [2],  pages  321  to  323. 
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4.  THE  INVERSION  OF  g(z) 


In  this  section  we  develop  the  method  for  deriving  a closed  fomi  expression 
for  g^  from  our  knowledge  of  the  ASMA  equation.  Specific  examples  will  then 
be  computed  in  the  next  section.  The  transfer  function  ^(z)  is  readily  deter- 
mined from  the  ARMA  equation,  see  (8).  Next,  we  get  the  transform  of  g^.from 
(24).  Thus  we  must  now  address  the  question  of  inverting  g(z).  It  is  possible 
to  have  different  sequences  with  the  same  bilateral  transform.  For  example, 
the  sequences 


b 

n 


for  n ^ 0 
otherwise 


(39) 


and 


•p°  ^ for  n < 0 


(40) 


0 otherwise 

have  the  same  tranform  b(z)  » c(z)  • z/(z-p).  The  difference  is  that  b(z) 
exists  for  |z|  > p whereas  c(z)  exists  for  |z|  < p.  Therefore,  to  determine 
uniquely  the  inverse  of  a bilateral  transform,  one  must  know  the  annulus  of 
convergence  of  that  transform.  We  had  shown  before  that  the  annulus  of  conver- 
gence of  g(z)  is  R < |z|  < 1/R,  with  R given  by  (17). 

The  function  g(z)  is  itself  a rational  function.  Replacing  z by  1/z  in 
(7)  we  obtain 


, 1 - 0,  z - • • • - 0 z'^ 

M^) 3—  (41) 

1 - 4>j^z  - •••  - (j)  z^ 


Since  each  pole  of  ij)(z) 
at  1/z  - a^,  or  z ■ l/o 


* Q(i) 


at  z - a^,  where  5*  0, 
we  can  write  (41)  as 


gives  rise  to  a pole  of  ^(1/z) 


(42) 
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where 

q(z)  - (z  - l/oL^iz  - HoL^  •••  (z  - l/Op)  (43) 

In  the  case  q > p,  iiiz)  has  poles  also  at  z = 0,  these  become  poles  of 
ijJ(l/z)  at  z = “>,  which  means  that  the  degree  of  P(z)  is  greater  than  the 
degree  of  Q(z).  Multiplication  of  (42)  by  (8)  yields  the  rational  function 
N(z)P(z) 


g(z) 


D(z)Q(z) 


(44) 


where  the  numerator  has  degree  m + q and  the  denominator  has  degree  m + p. 

In  order  to  facilitate  the  Inversion  of  (44)  we  will  exploit  the  symmetry 
property  of  g^  and  we  will  reduce  the  Inversion  of  a bilateral  Z-transform  to 
the  simpler  inversion  of  an  ordinary  Z-tranform.  Since  g^  is  symmetric  we 
can  represent  it  by  its  value  at  k » 0 and  by  the  symmetric  right  and  left 
lobes.  Thus,  if  we  define 

r 0 for  k < 0 


[ gj^  for  k > 0 


(45) 


we  can  write 

8k  " 8o\  \ + ^-k 

The  tranform  of  (46)  is 

i(z)  - gQ  + h(z)  + h(-i)  (47) 

where  h(z)  is  an  ordinary  Z-tranform  which  converges  for  [z]  > R and  where 
h(-^)  converges  for  \z\  < 1/R.  From  (45)  and  the  definition  of  the  Z-transform 
follows  the  asymptotic  behavior 


- 8i 

h(z) as  z -*■  “ 

z 

h(~)  ~ as  z -*■  0 


(48) 

(49) 
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where  condition  (49)  implies  that  h(— ) is  divisible  by  z.  We  note  the  fol- 

z 

lowing  facts.  First,  h(z)  and  h(-^)  are  rational  functions.  If  h(z)  were  not 

rational  then  h(-^)  would  not  be  rational  and  g(z)  could  not  be  rational, 

which  is  a contradiction.  Second,  the  poles  of  h(z)  and  h(— ) combined  must 

z 

be  the  poles  of  g(z),  that  is,  the  poles  of  ij»(z)  and  ii((— ) combined.  Third, 

z 

for  each  pole  that  h(z)  has  at  z =a.  0,  h(— ) must  have  a pole  at  z • 1/a.. 

1 z 1 

Since  h(z)  converges  for  |z|  > R all  of  its  poles  lie  inside  or  on  the  circle 

of  radius  R,  and  hence  are  identical  to  the  poles  of  ipCz) . Likewise,  the 

poles  of  h(— ) are  identical  to  the  poles  of  We  can  therefore  write  (47) 

z z 

as 


g(z) 


Nj^(z)  N2(z) 

TcIT  'our 


(50) 


where  Nj^(z)  is  a polynomial  of  degree  m - 1 and  N2(z)  is  a polynomial  of  degree 
q.  Because  of  the  S3rmmetry  of  gj^  we  have  complete  information  about  it  if  we 
know  gQ  and  hj^.  We  let 

\ \ ^51) 

and 

f(z)  * gg  + (52) 

Clearly,  f(z)  is  an  ordinary  Z-transform  which  can  be  written  as 


f(z) 


M(z) 

D(z) 


where  D(z)  is  the  characteristic  polynomial  given  by  (16), 


(53) 


and  where  the  degree 


of  M(z)  is  the  same  as  the  degree  of  D(z)  since 

f(z)  8q  as  z -*■  CO  (54) 

Equation  (50)  becomes 


M(z)  N2(z) 

■ snr  ^ onr 


(55) 
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Our  objective  is  to  determine  f(z)  from  g(z).  This  means  that  we  must  find 
the  coefficients  of  the  polynomial  M(z) , which  is  most  expediently  done  by 
partial  fraction  expansion.  However,  a unique  expansion  of  M(z)/D(z)  is  not 
possible  because  it  is  not  a proper  rational  function.  We  therefore  divide 
g(z)  by  z and  obtain 


i(3>. 


zD(z) 


Q(z) 


(56) 


Note  that  because  of  (49)  N2(z)  is  divisible  by  z,  hence  we  have  N2(z)  = N2(z)/z. 


Now  we  can  write  the  expansion 

M(z)  M,(z) 

) ^ D (z) 


f(z)  , 
z zD(z 


(57) 


which  is  analogous  to  (18).  Furthermore 


to-  , 


N(z)P(z) 

zD(z)Q(z) 


N3(z) 


M^(z) 


(58) 


The  D^(z)  are  the  factors  of  D(z)  and  include  an  additional  factor  z if  N(z) 
is  not  divisible  by  z.  The  M^(z)  are  polynomials  that  have  one  degree  less 
than  D^(z) . We  see  that  the  sequence  fj^  has  exactly  the  same  structure  and 
is  made  up  of  the  same  sequences  as  the  Impulse  response  only  with  dif- 
ferent coefficients.  The  final  and  important  result  is  that  the  coefficients 
of  the  M^(z)  in  (58)  are  determined  from  g(z)/z  by  the  identical  procedure 
by  which  the  coefficients  of  the  N^(z)  in  (18)  are  determined  from  ^(z)/z. 
Although  (58)  in  comparison  with  (18)  has  the  additional  term  N3(z)/Q(z), 
this  term  does  not  affect  the  procedure  (which  is  based  solely  on  the  factors 
Dj^(z))  because  Q(z)  does  not  contain  any  of  the  factors  Dj^(z). 

The  analysis  up  to  this  point  has  focused  on  the  underlying  concepts.  We 
emphasize  however  that  the  implementation  of  the  method  is  very  simple.  It 
involves  the  following  steps. 

1.  Determine  g(z)  from  the  AKMA  equation. 
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2.  Perform  a partial  fraction  expansion  of  g(z)/z  into  terms  whose 
denominators  comprise  all  factors  D^(z). 

3.  Multiply  the  expansion  by  z and  invert. 

Specific  examples  of  this  procedure  for  simple  linear  factors,  repeated 
linear  factors,  and  quadratic  factors  are  given  in  the  next  section.  A sum- 
mary of  the  results  of  a number  of  solved  cases  is  given  in  Section  6.  Details 
of  their  derivation  are  available  from  the  author  upon  request. 

5 . EXAMPLE  CASES 

5.1  SIMPLE  LINEAR  FACTORS 

Example  1:  We  consider  the  case  ARMA  (2,  2)  for  which  (1)  becomes 


X - ({>,x  , - (t)-x  T = a - 0,a  - 0-a  . 

n 1 n-1  2 n-2  n 1 n-1  2 n-2 


The  transfer  function  (8)  is 


^(z) 


z - Q^z  - 02  N(z) 


Z ~ - 4.2 


D(z) 


Now  let  the  zeroes  of  D(z)  be  and  02*  We  then  have 


(59) 


(60) 


D(z)  - (z  - a^iz  - ct^)  (61) 

and  ®2’  *^2  * ”'^l'^2*  first  find  the  transfer  function.  Division 

of  4'(z)  by  z introduces  an  additional  pole  at  ■ 0 because  N(z)  is  not 
divisible  by  z.  The  partial  fraction  expansion  is 


z z z-Oj^  z-a2 


(62) 


where  we  find  the  coefficients  by  the  standard  method,  see  [2] 

i - 0,  1,  2 (63) 


(z-a^)>i>(z) 


z-a. 


; 


( 


I 

4 

( 
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specifically  we  obtain 


z - - 9^ 


{z-a^  (2-02) 


z“0 


“l“2 


(64) 


And  in  the  same  manner  we  find 


°^i  ' - ^2 

01(0.1-02) 


(65) 


“2  ~ Vl  - ^2 

02(02-01) 


(66) 


Multiplication  of  (62)  by  z and  inversion  yields  the  impulse  response 


ip  ” A_5  + A1O?  + A_o!J 

n On  11  2 2 


To  obtain  the  sequence  f^^  we  note  that  it  must  have  the  same  structure 
impulse  response,  namely 


(67) 
as  the 


f,  =■  B-5,  + B,oJ^  + B-o^ 
k Ok  11  2 2 


(68) 


where 


(z-a^)ip(z)4i(j) 


z»a 


, 1 - 0,  1,  2 


(69) 


Clearly  then  we  have 


“i  • ♦<^>''1 


(70) 


We  obtain  from  (60) 


.,1,  - "2" 

♦<-) 


(1-OjZ)  (1-022) 


(71) 


and  the  coefficients  are  from  (70)  and  (71) 


®0  “ '^O 


(72) 


^ ~ Vl  ~ ”1^2 

(1-0^)  (l-aj^02) 


(73) 
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(74) 


1 - - 0202 
B_  ” 2 

(l-a^a2) (1-02) 

This  example  demonstrates  amply  the  simplicity  of  the  procedure  and  its  sub- 
stantial advantages  over  the  approach  mentioned  in  Section  3.  We  note  that 
it  is  not  necessary  to  first  find  the  impulse  response  and  its  coefficients  A^. 
The  structure  of  (68)  is  known  from  the  poles  of  ijl(z)/z  and  the  coefficients 
may  be  obtained  directly  from  (69).  However,  since  these  coefficients 
will  always  satisfy  the  product  form  (70),  it  seems  convenient  to  express  them 
in  that  form. 

Examp le  2 : Whenever  the  order  p of  the  autoregressive  part  is  greater  than 
the  order  q of  the  moving  average  part,  the  division  of  t^(z)  by  z merely  cancels 
an  existing  factor  z in  the  numerator  N(z).  As  an  example  we  take  the  system 
ARMA  (2,  1).  Equation  (1)  becomes 

n 1 n— i L n— z n 1 n— 1 
and  the  transfer  function  is 


z - 9^z 


z - - 


Now  let  the  denominator  of  ii(z)  be  factored  as 


D(Z)  =■  (z  - Cl)  (z  - B) 


we  have 


hiz)  . ^ ~ ^1 

z (z-a)(z-8) 
and  the  expansion  (41)  becomes 


z - a z - 8 


The  impulse  response  is 


. n . 

- A.a  + A-6 
n 1 Z 
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where,  from  (63) 


Furthermore 

'k 

where 


a - B 


k k 


6 - a 


(81) 


(82) 


^ - 0 - 
2 la 
a 


S0, 


1 - ae. 


3) 


(1  - a^)(l  - aB)  ^ 


(1  - aB)(l  - B ) 


(83) 


(84) 


5.2  REPEATED  LINEAR  FACTORS 

We  consider  now  the  case  where  one  of  the  factors  of  zD(z)  occurs  more 
than  once.  Let  S be  a zero  of  zD(z)  with  multiplicity  k.  Then  we  can  write 


zD(z)  - (z  - B)  D2(z) 


and  the  transfer  function  is  expanded  as 

^(z)  . N(z)  _ ^1^^^  ^2^^^ 

z ” zD(z)  ” (2  - B)^  ^2(2) 

where  the  term  of  interest  has  the  further  expansion 


Nj^(z) 


V] 


k k k-1 

(z  - B)  (z  - B)*"  (z  - B)  ^ 


z - B 


(85) 


(86) 


(87) 


We  need  to  determine  the  coefficients  A^^,  A^,  ...t  this  end  we 

define  the  function 


P(z) 


'i'(z) 


(z  - B) 


(88) 


i 
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It  now  follows  from  (86)  and  (87)  that 


k-1  ^2^==^  k 

P(z)  = Aq  + A^(z  - 6)  + ...  + - 6)*"  -^  + (z  - 8)*"  (89) 

and  the  required  coefficients  are  isolated  by  evaluating  P(z)  and  its  derivatives 
at  z * 6.  Thus  we  have 
Aq  * P(6) 


A^=^P(z) 


z=e 


A .i-sip(z) 

^ ^ • dz-' 


(90) 


After  the  coefficients  have  been  determined  we  multiply  (87)  by  z and  invert. 
The  inverse  transformation  is  denoted  by  the  operator  symbol  _Z  In  the 
case  8 ^ 0 we  use  the  rule 


1-G^) 


n+l-j 


(91) 


,(z  - 6)' 

from  which  it  follows  with  (96)  that 


,-l 


Nj^(z) 


L(z  - s) 


k-1  . . 

‘j  (k  - " - l)  “ 


n+l-k+j 


(92) 


.1-J 


In  the  case  6 * 0 we  require  the  inverse  transform  of  z which  is  simply  a 
unit  impulse  at  the  position  n = j - 1,  namely 


n+l-j 

and  the  inverse  transform  of  (87)  becomes 


(93) 


-1 


Nj^(z)' 


k-1 


I Aj6 


J-0 


n+l-k+j 


(94) 
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The 


expansion  of  the  transform  of  the  function  fj^  in  analogy  to  (86),  is 


f(z)  ^ ^ “2^^^ 

" ‘ (z  - 6)'" 


(95) 


where 


M^(z) 


B,  B,  , 

0.1  . . k-1 

+ ; — — + • • • + 


(z  - 6)^  (z  - 6)^  (z  - 8)^  ^ 


After  defining  the  function 


ijl(z)i(;(^)  , _ , 

Q(z)  = (z  - B)  = P(z)il»(— ) 

z z 


z - 6 


(96) 


(97) 


we  obtain 


Bq  “ 


®1  = -h  |z=6  = V^B^  lz=B 


B.  = ^ ^ Q(z) 


z=B 


It  then  follows  that 


(98) 


Z 


-1 


M^(z) 


(z  - B) 


j^o  (k  - J - 1)  ^ 


n+l-k+j 


^n+l-k+j 


for  B 0 


for  B = 0 


(99) 


Example  3:  We  consider  the  system  ARMA  (2,  1)  whose  characteristic  polynomial 
has  a double  zero  at  z = B-  Equation  (1)  becomes 

^n  ■ ^^Vl  ®^V2  ■ ^n  - ®lVl 


19 


and  the  transfer  function  is 


4>(z) 


z - 
(z  - 6)^ 


(101) 


In  accordance  with  (88)  we  find 

P(z)  = z - 9^;  ■^P(z)  = 1 (102) 

and  the  coefficients  of  the  impulse  response  are  computed  from  P(z)  by  (99)  as 
Aq  = 8 - e^;  = 1 (103) 

The  inverse  transform  (91),  for  j = 1 and  j = 2 is 


L(z  - 8)  J 


= n8 


n-1 


.(z  - 8) 

and  the  impulse  response  becomes 


i(<  = (8  - 9^)08”"^  + 

n JL 


The  function  Q(z)  defined  in  (97)  is 


(104) 


(105) 


Q(z)  = (z  - 9^) 


1 - 9^z 
(1  - 6z)" 


(106) 


and 


dz 


Q(z) 


1 - 29^8  + 9^  + (8  + 0^6  - 29^)z 

(1  - 6z)^ 


(107) 


The  coefficients  of  f^^  are  computed  with  (98)  as 
(8  - 9^)(1  - 9^8) 


TT 
(1  - 6 ) 


(108) 
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r 


(1  + 6^)(l  + 0^)  - 49^6 
(1  - 


Finally  we  have 


(109) 


(110) 


Example  4:  We  treat  here  the  system  ARMA  (1,  3),  which  induces  a triple  zero 


at  z = 0.  Equation  (1)  becomes 


X - (b.x  , = a - 0,a  , - 9_a  . - 0_a 

n ^1  n-1  n 1 n-1  2 n-2  3 n-3 


(111) 


and  the  transfer  function  is 


z (z  - (t>^) 


(112) 


In  this  case  D(z)  has  a double  zero  at  z = 0,  and  the  division  by  z 
introduces  the  third  zero.  The  partial  fraction  expansion  is 

z 3 2 z z - 

z z 1 

where  the  coefficient  A3  is  determined  by  the  method  for  linear  factors, 


namely 


A 

3 3 


- 02*1  - 0- 


(114) 


To  obtain  Aq,  A^  and  A2  we  use  the  method  for  repeated  linear  factors.  From 
( 88)  follows 


P(z)  ••  ii)(z)z 


2 - 01^^  - 02^  - 63 

z - (t. 


, 3z^  - 20tZ  - 0,  z^  - 0,z^  - 0-z  - 0- 

d ^ 2 1 2 3 

^ ■ **^1  (2  - *1)^ 


(115) 


(116) 
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1 

2^2 

dz 


P(z) 


3z  - 6, 


z - 


(3z  - 26^  - 62)  (z-*  - - 92Z  - 83) 


(z  - 1^^)' 


(z  - llj^) 


(117) 


Evaluation  of  (115),  (116)  and  (117)  at  z = 0 yields 

A - 

0 

“2  . *3  «2*1  * “3 

*1-  — 

1 *1  *1 

» »1*1  ^ °2*1  ^ °3 

2 " 2 ■*■  3 " 3 

1 


(118) 


The  impulse  response  is 


lii  - A-6  » + A,  5 , + A.d  + A-4.  ‘ 
n 0 n-2  1 n-1  2 n 3^1 

.T.l 


(119) 


Now,  because  Q(z)  « P(z)ili(—),  the  equations  (98)  for  the  coefficients  B_,  , 

Z U i 


and  B2  become 


z“0 


"1  ■ + ‘0  ^ »<i>]z.o 

'2  - * *1  £ ♦<!>  *1^72  *<¥>1 


z”0 


(120) 


where 


, 1 - 9 z - 6^z^  - 9«z^ 

T — 

z 1 - (pj^Z 

. , -9.  - 29-z  - 36,z^  (|),(1  - 9,z  - 9,z^  - 9,z^) 

-H_  5;  (i)  ■ i £ J — i Z j — 

dz  "^^z’  1 - <P,2  ^ a2 

1 (1  * 

j2  _ -202  - 69-z  2((.j^(9  + 262Z  + 30-z^) 

^ ^^z^  ” 1 - ♦ z ~ ~ 72 

dz  ^1  (1  - (p^z) 

^ 2^J(1  - 9j^z  - 02Z^  - 03Z^) 

(1  - ♦iZ)^ 


(121) 
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Substituting  these  results  into  (120)  gives 


®0  “ ^0 


Bi  - + (^1  - Bl>Ao 


B2  =*  A2  + - 92)Aq 


(122) 


The  function  f,  is 
k 


f,  » B.6,  * + B,6,  , + B-6,  + B.iJ), 
k 0 k-2  1 k-1  2k  31 


(123) 


where  B^  is  obtained  as 


Bj  - A3»(i) 


I - - 6^ 


(124) 


5.3  QUADRATIC  FACTORS 

A quadratic  factor  with  real  coefficients  arises  as  the  product  of  two 

i6 

linear  factors  with  complex  conjugate  zeros.  Let  these  zeros  be  at  ae 
“16 

and  ae  , where  1 denotes  the  imaginary  unit.  We  then  obtain  the  quadratic 
factor 

Dj^(z)  ■ (z  - ae^®)(z  - ae  z"  - 2az  cos6  + a^  (125) 

Now  let  the  denominator  D(z)  of  the  transfer  function  contain  the  quadratic 
factor  Dj^(z).  We  can  write 


zD(z)  - Dj^(z)D2(2) 

and  the  transfer  function  has  the  expansion 
z D, (z)  D„(z) 


(126) 
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N^(z)  Is  a polynomial  of  degree  one  and  has  two  open  coefficients  which  are 
to  be  determined  by  the  method  of  partial  fraction  expansion.  If  we  write 


Nj^(z)  in  the  form 


where 


Nj^(z)  = A[z  sin  y + a sin(g  - y)  ] 

= sin  B + A^Cz  - a cos  3) 


A^  * A cos  y;  A2  = A sin  y 


(127) 


then  the  inverse  transform  of  the  first  term  of  (126)  multiplied  by  z is 


zN^(z) 

7 

~ D^(z) 


Aa  sin  (n6  + y) 


a [Aj^  sin  nB  + A2  cos  nB] 


(128) 


Thus  every  transform  with  denominator  Dj^(z)  represents  a damped  sinusoid  of 
amplitude  Aa'',  frequency  B,  and  phase  angle  y.  We  have  to  determine  the  values 
of  A and  y or  of  A^  and  A2.  We  first  define  the  function 


P(z) 


^ i’.(-) 

Z 1 


(129) 


It  then  follows  from  (126)  and  (127)  that 


N2(z)D  (z) 

P(z)  » A-a  sin  B + A_(z  - a cos  B)  + — ri  r \ 

I z U2\z) 

The  required  coefficients  are  isolated  by  letting  z take  on  the  value 
Ifi 

Zq  ■ oe  “ a(cos  B + 1 sin  B) 

This  value  is  a zero  of  Dj^(z),  hence  Dj^(Zq)  ■ 0.  We  then  obtain 

P(Zq)  * Aj^a  sin  B + A2(a  cos  B + la  sin  B - a cos  3) 

- a sin  B(Aj^  + IA2) 


(130) 


(131) 


and,  dividing  by  a sin  B 

P(Zo) 

a sin  B ” ^1  ^2 


(132) 


(133) 


The  values  of  Aj^  and  A2  are  now  readily  determined.  We  note  that  P(Zq)  Is  simply 
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a complex  number.  Denoting  its  real  part  by  R and  its  imaginary  part 


by  I,  that  is,  letting 


P(Zq)  = R + il 


we  find 


(134) 


/r^  + I 

T-  ; Y “ arc  tan  — 

a sin  6 R 


(135) 


or 


• A 


1 a sin  6 ’ 2a  sin  6 

An  analogous  procedure  applies  to  the  transform  f(z).  As  the  counterpart  to 


(136) 


(126)  we  have  the  expansion 

f (z)  ^ ^1^^^  ^2^^^ 

z D, (z)  D_(z) 


(137) 


where 


and 


M^(z)  = B[z  sin  e + a sin  (6  - e)] 

= Bj^a  sin  8 + B2(z  - a cos  8) 
Bj^  • B cos  e;  B2  * B sin  £ 


We  define  the  function 


’i!(z)>i'(7)  _ , 

Q(z)  - D^(z)  « P(z)ii;(— ) 


(138) 


(139) 


and  obtain 


a sin  8 * ®1  '''  ^®2 


(140) 


T,  1 


Now  let  and  C-  be  the  real  and  imaginary  parts  of  (J<( — ).  It  then  follows  that 


^^"0^  - 1 

- (^1  ^ ^2>(S  ^ 


(141) 


and  also  that 


B,  - Aj^C^  - A2C2;  B,  - A^C,  + A,C 


1“2  2^1 


(142) 
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(143) 


Excorrple  5:  Consider  the  system  ARMA  (2,  2)  governed  by  the  equation 


X - 2a  cosS  X , + a X - 
n n-1  n-2 


a - 9. a - 9a 
n 1 n-1  2 n-2 


The  transfer  function  is 


♦ (z) 


- 9^2  - 92 

~2  2 
z - 2az  cos  B + o 


and  the  partial  fraction  expansion  of  i{i(z)/z  has  the  form 


A„  A, a sin  6 + A, (z  - a cos  S) 


■Kz)  . 20  ^ 21 

Z 2 ■' 


2 2 
z - 2a2  cos  B + a 


(144) 


(145) 


By  the  usual  method  for  linear  factors  we  find 

-®2 

Ag  - 4<(0)  - 

a 

Next  we  let  in  accordance  with  (129) 


z - 9^z  - 92  , 

P(z)  = * 2 - 9,  - 9„z 

Z L I 


This  function  is  now  evaluated  at  z. 


P(z  ) - ae^®  - 9 - -2 
0 la 

®2  ®2 

“ (a ^)  cos  B - 9,  + i(a  + — ) sin  B 

a la 

After  dividing  (148)  by  a sin  B and  comparing  it  with  (133)  we  see  that 


(146) 


(147) 


(148) 


^2 

^ " (1  - ^)  cot  B - ^ 


a 
®2 

A2  - (1  + -f)  - 1 - Aq 


sin  B 


(149) 


The  Impulse  response  is 


'ii  “ A^d  + a (At  sin  B + A~  cos  nB) 
non  1 2 


(150) 
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The  function  has  the  same  expansion  as  (144) , namely 


(151) 


where 


®0  ’ 3-0 


(152) 


In  order  to  find  B and  B-  we  must  evaluate  ij;(— ) at  z 
i ^ z 

and  (125) 


Zf..  We  have  from  (144) 


Z2  - 9^z  - 02 

, iB,,  -iB, 

(z-cte  )(z-cte  ) 


(153) 


and  therefore 


1 - Q^z  - e^z 

T^  iB.  ,,  -iB, 

(1  - zae  )(1  - zae  ) 


(154) 


Substitution  of  z^  - ae  in  (154)  yields 


, . iB  o 2 2i6 

1-0, ae  -9,oe 

,,  2 2iBx.,  2, 

0 (1-ae  )(l-a) 


/,  a iB  „ 2 2i3v/,  2 -2iB. 

(1  - 0j^ae  - 92a  e )(1  - a e ) 

(1  - 2a^  cos  26  + a^)(l  - a^) 


(155) 


We  let  and  D2  be  the  real  and  imaginary  parts  of  the  numerators  of  (155). 


We  thus  have 


n , a i8  o 2 216  2 -216  ^ 3 -16  ^ „ 4 

+ ID2  - 1 - 9j^ae  - 6201  e - a e + 9j^a  e + 92a 


(156) 


and  after  separating  real  and  imaginary  parts 


- 1 + 9201^  + 9j^(a^-a)  cos  6 - a^(l  + 92)  cos  26 
D2  * -9j^(a  + a^)  sin  B + a^(l  - 62)  sin  26 


(157) 


(158) 


i 
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The  result  is  that 


- 1 

^(  ) = + 1C2  = f 1 Y- 

^0  (1  - 2a  cos  23  + a )(1  - a ) 


(159) 


and  and  B2  are  given  by  (142). 

Since  it  is  not  possible  to  work  out  simple  expressions  for  B^^  and  B^  in 
terms  of  the  coefficients  a,  6,  0^  and  we  now  work  a numerical  case. 

Let  (143)  be 


a -1.4x  ,+0.98x  o=a  +a  .-a  _ 

n n-1  n-2  n n-1  n-2 


(160) 


In  this  case  we  have 


= -1; 


02  - 1 


a^  = 0.98;  3 = | 


cos  3 = sin  3 * 1//  2 


a sin  3 = ot  cos  3 • 0.7 


cos  23  * 0,  sin  23  = 1 


substitution  of  the  appropriate  values  in  (148)  gives 
P(Zq)  - 0.98571  + 1(1.41429) 
and  using  (136)  we  obtain 
A,  - 1.40815 


(161) 


- 2.020414 


(162) 


From  (146) 

Aq  - -1.02041 

So  the  impulse  response  (150)  becomes 


- -1.02041  6^  + (0.98)"'  (1.40815  sin  ^ + 2.02041  cos  ^)  (153) 
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We  further  have  from  (155) 


, [1  + 0.7(1  -f  i)  - 0.98i](l  -f-  0.981) 
^0  (1  + 0.98^)(1  - 0.98) 


, 1.9744  + 1.3861 
0.039208 

and  with  (142),  (159)  and  (162) 


50.357  + 35.351 


(164) 


- -0.51143 

- 151.52 

It  therefore  follows  that  the  function  f,  is 

k 

- -1.02041  6^  + (0.98)^^,^(-0. 51143  sin  ^ + 151.52  cos  ^)  (165) 


6.  SUMMARY  OF  SOLVED  CASES 


This  is  a summary  of  the  form  of  the  impulse  response  and  of  the  auto- 
covariance function  corresponding  to  the  most  frequently  encountered  ARMA 
equations.  In  listing  the  various  cases  we  use  the  numbers  (1),  (2),  (3) 
on  the  left  margin  to  denote: 

(1)  The  defining  ARMA  equation 

(2)  The  impulse  response  ip  , and  its  coefficients 

n 

(3)  The  normalized  autocovariance  function  g^,  and  its  coefficients 

We  note  that  the  autocovariance  function  of  the  filter  output  is  g^^  multl- 

2 

plied  by  the  variance  of  the  filter  input  a^.  Also,  the  expression  given 
for  gj^  represents  the  autocovariance  function  only  for  k ^ 0.  For  k < 0 
the  symmetry  is  used,  that  is  g ■ gj^. 

CASE  1:  ARMA  (0,  1) 


(1) 

(2) 

(3) 


m 

a - 9, a , 

n 

n 1 n-1 

6 - 0,6  , 

n 

n 1 n-1 

■ (1  * 


I 


I 
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CASE  2:  ARMA  (0,  2) 


(1) 

X 

-a  - 9, a , 

0-a  « 

n 

n 1 n-1 

2 n-2 

(2) 

'I' 

=•6  - 9,5  , 

9»5  - 

n 

n 1 n-1 

2 n-2 

(3) 

*k 

■ 

+ 

(-0^+0 

CASE 

2'- 

ARMA  (0,  3) 

(1) 

X 

■a  - 9, a , 

0-a  _ 

n 

n 1 n-1 

2 n-2 

(2) 

'P 

-5  - 9,5  , 

_ 

B2  o 

n 

n 1 n-1 

2 n-2 

(3) 

8k 

- (1+9^+92+03)  5j, 

. + (-9 

CASE  4;  ARMA  (1,  0) 

(1)  X - li.x  , * a 
n n-1  n 


(2) 

(3)  gj^  - ^1/(1  - 
CASE  5;  ARMA  (1,  1) 

<«  -♦iVl  ■ \ - »lVl 

*0  ■ *0  ■ «l'*l 


O)  . A„i  B^ ^ 

CASE  6;  ARMA  (1,  2) 

’'n  - “^iVl  * - ®lVl  - ®2V2 

(2)  - Ao6^  + A^6^.^  + A^^J 

01<^1  + 02  02 

A * • A m A 9 1 M A 

*0  2 ' *1  ♦ ^2  ^ ^0 
♦l  1 

(3)  *1  - * B^^J 


(1  - 0^^^)(1  - Aq) 
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1 - 9 ^ - 6 4, 

Bq  » Aq  + (4,^  - = A^;  B^  = — — ^ 

1 - 4>, 


CASE  7;  ASHA  (1,  3) 

*0  - ^iVl  ■ S - «lVl  • “2V2  - «3V3 

«)  ♦„  - + *!«„-!  + *2'„-2  * h*l 


9l*l  * »2*1  °3  . °2*1  * ^3  . ^3  . , , , 

*0  “ 3 ’ *1  ■ 2 ’ *2  ♦ ’ *3  ^ *0 

'Pi  <Pl  1 


<3)  gw  = ®2\-2  + hh 


B„  » A^  + (4>,  - 03^)A^  + (4-,  - e.-tii  - 9,)A,  ; B,  = A,  + (4>,  - SJA,; 


I'^l  ''2'  2 


'r"2’ 


1 - 9 4>i  - 02^^  - 03<^i 

B2  = A2  ; B3  = ^ P ^ A3 

1 - 

CASE  8;  ARMA  (2,  0) 

Set  63^  = 0 in  Cases  9,  or  10,  or  13. 

CASE  9;  ABMA  (2,  1)  vrfiere  the  characteristic  polynomial  has  two  real  zeros, 
That  is,  z ■ a and  z * 3.  We  then  have 
2 

z - (t>^z  - 4*2  = (z  - a)  (z  - B) 

(1)  X - (a  + 6)x  , + aBx  , = a - 9a 

n n-1  n-2  n i n-i 


(2)  + A^b“  i A„  - 


3 - 0, 


; A 


1 3 - o ’ 


k k ^ ” °*®1 

(3)  g^^-Bga  +B^3  ; Bq. 


^0  5 ®1 


1 - 39, 


(1  - o3)(l  - 3^)  ^ 


(1  - o‘)(l  - a3) 

CASE  10;  ARMA  (2,  1)  where  the  characteristic  polynomial  has  a double  zero  at 
z > 3.  We  then  have 


2 2 2 
z - (pj^z  - (>2  “ * ~ 23z  + 3 
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(1)  X_  - 


26x  ^ + 6 X - = a - 0a 

n-1  n-2  n 1 n-1 


(2) 


(3) 


AQne"'^  + 8 " ; Aq  = g - 6^^  ; = 1 

t T , (B  - 0J(1  - 66.)  (l  + B^)(l+0h  - 460, 

BokB-^  + B/;  B,  = ■ ^ = — ^^5 ^ 


(1  - 3 ) 


(1  - 3 )' 


CASE  11:  AEMA  (2,  2)  where  the  characteristic  polyrvomial  has  two  real  zeros, 

that  is,  z = a and  z = B.  We  then  have 
2 

z - (p^z  - <t>2  = (z  - oi)(z  - 6) 

(1)  X - (a  + B)x  , + aBx  o = a - 3ia  - 0a  , 

n n-1  n-2  n 1 n-1  2 n-2 

(2)  * »'  A 6 + A + A-B" 

n U n 1 / 

^2.  , - °2  , - °2 
0 * 03  ’ 1 “ 0(0  - 8)  ’ 2 “ 8(3  - o) 


1 - 06  - 0^0  1 - 60^  - 3^0, 

B„  = A_  ; B,  = 5 A ; B«  * ^ A. 

^ ^ ^ (l-o^)(l-o3)  ^ ^ (l-oB)(l-B^) 

CASE  12:  ARMA  (2,  3)  where  the  characteristic  polynomial  has  two  real  zeros, 

that  is,  z * o and  z * 8.  We  then  have 

2 

z - (p^z  - <t>  “ (z  - o)(z  - 6) 

1 z 


(1)  X_  - 


(o  + B)x  , + o3x  , = a - 0-a  , - 0„a  „ - 6«a  _ 

n-1  n-2  n 1 n-1  2 n-2  3 n-3 


n . . „n 


® - Vn  * * V 


e (a  + 6)6,  e 

06  (^3)2  • ^1  03  * ^2 

3^  - 3^0j^  - 302  - 63 


3 2„  ^ 

o - o 0^  - 002 

0^(0  - 3) 


3 (3  - o) 


. t 


»>  «k  ■ W * 'l\-l  + “2“'  * “3®" 


Bq  = Aq  + (Ct  + 3 - 0j^)A^  ; \ = \ 


1 - ae,  - - a^9_ 

1 ^ J 

(1  - a^)(l  - a6) 


1 - 36  - 3^9,  - 3^0. 

B = i ^ ^ A 

(1  - a3)(l  - 6^) 


CASE  13;  ARMA  (2,  1)  where  the  characteristic  pol3moinial  has  complex  conjugate 

iS  “iB 

zeros,  that  is,  Zq  » ae  and  z^^  = ae  . We  then  have 

2 2 2 
z - - (j)2  “ z - 2az  cos  3 + a 

2 

(1)  X - 2a(co3  3)x  , + a X - = a - 6a 

n n-1  n-2  n 1 n-1 

(2)  \l>  = a'^(A^  sin  n3  + A,  cos  n3) 

n u i 


^0  * 3 - ; A^ 


(3)  8;^  “ “ (3q  sin  k3  + B^^  cos  k3) 

®0  “ ^0^1  ” '^1^2  ’ * ^0^2 

4 3 2 

- 1 + a + 0^(a  - a)  cos  3 - o cos  23 

C - Re  ^C-^) ^ ^ 2 

^0  (1  - 2a  cos  23  + a )(1  - a ) 

, -0,(a  + o^)  sin  3 + sin  23 

Co  ” “ 2 4 2 

0 (1  - 2a  cos  23  + a)(l-a) 


CASE  14;  ARMA  (2,  2)  where  the  characteristic  polynomial  has  complex  conjugate 

IB  “iB 

zeros,  that  is,  Zq  * ae  and  z^^  ■ ae  . We  then  have 

2 2 2 
z - (pj^z  - (f>2  “ 2 ~ 2az  cos  8 + 0“ 
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